Learning stochastic dynamics with statistics-informed neural network

نویسندگان

چکیده

We introduce a machine-learning framework named statistics-informed neural network (SINN) for learning stochastic dynamics from data. This new architecture was theoretically inspired by universal approximation theorem systems, which we in this paper, and the projection-operator formalism modeling. devise mechanisms training model to reproduce correct statistical behavior of target process. Numerical simulation results demonstrate that well-trained SINN can reliably approximate both Markovian non-Markovian dynamics. applicability coarse-graining problems modeling transition Furthermore, show obtained reduced-order be trained on temporally coarse-grained data hence is well suited rare-event simulations.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Self-informed neural network structure learning

We study the problem of large scale, multi-label visual recognition with a large number of possible classes. We propose a method for augmenting a trained neural network classifier with auxiliary capacity in a manner designed to significantly improve upon an already well-performing model, while minimally impacting its computational footprint. Using the predictions of the network itself as a desc...

متن کامل

Stochastic Dynamics of Learning with Momentum in Neural Networks

We study on-line learning with momentum term for nonlinear learning rules. Through introduction of auxiliary variables, we show that the learning process can be described by a Markov process. For small learning parameters and momentum parameters close to 1, such that = =(1 ?) 2 is nite, the time scales for the evolution of the weights and the auxiliary variables are the same. In this case Van K...

متن کامل

Learning Document Image Features With SqueezeNet Convolutional Neural Network

The classification of various document images is considered an important step towards building a modern digital library or office automation system. Convolutional Neural Network (CNN) classifiers trained with backpropagation are considered to be the current state of the art model for this task. However, there are two major drawbacks for these classifiers: the huge computational power demand for...

متن کامل

Stochastic learning in a neural network with adapting synapses

We consider a neural network with adapting synapses whose dynamics can be analitically computed. The model is made of N neurons and each of them is connected to K input neurons chosen at random in the network. The synapses are n-states variables which evolve in time according to Stochastic Learning rules; a parallel stochastic dynamics is assumed for neurons. Since the network maintains the sam...

متن کامل

Stochastic functional population dynamics with jumps

In this paper we use a class of stochastic functional Kolmogorov-type model with jumps to describe the evolutions of population dynamics. By constructing a special Lyapunov function, we show that the stochastic functional differential equation associated with our model admits a unique global solution in the positive orthant, and, by the exponential martingale inequality with jumps, we dis...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of Computational Physics

سال: 2023

ISSN: ['1090-2716', '0021-9991']

DOI: https://doi.org/10.1016/j.jcp.2022.111819